BioNLP'09 Shared Task on
Event Extraction
in conjunction with
BioNLP, a NAACL-HLT 2009
workshop, June 4-5 2009, Boulder, Colorado
Final Evaluation Results
on Regulation events by Ev. Decom. - Approx. Span & Recur. matching
Task 1
------------------------------------------------------------------------------------------------
TEAM gold (match) answer (match) recall prec. fscore
------------------------------------------------------------------------------------------------
[JULIELab ] Regulation 338 ( 119) 312 ( 119) 35.21 38.14 36.62
[ConcordU ] Regulation 338 ( 91) 174 ( 91) 26.92 52.30 35.55
[ UTurku ] Regulation 338 ( 95) 215 ( 95) 28.11 44.19 34.36
[UT+DBCLS ] Regulation 338 ( 91) 198 ( 91) 26.92 45.96 33.96
[ UZurich ] Regulation 338 ( 48) 121 ( 48) 14.20 39.67 20.92
[VIBGhent ] Regulation 338 ( 49) 144 ( 49) 14.50 34.03 20.33
[ UNSW ] Regulation 338 ( 48) 161 ( 48) 14.20 29.81 19.24
[ UTokyo ] Regulation 338 ( 40) 81 ( 40) 11.83 49.38 19.09
[ Cam ] Regulation 338 ( 34) 77 ( 34) 10.06 44.16 16.39
[ NICTA ] Regulation 338 ( 54) 354 ( 54) 15.98 15.25 15.61
[UAntwerp ] Regulation 338 ( 35) 122 ( 35) 10.36 28.69 15.22
[ Team 24 ] Regulation 338 ( 24) 92 ( 24) 7.10 26.09 11.16
[ SCAI ] Regulation 338 ( 34) 280 ( 34) 10.06 12.14 11.00
[CNBMadrid] Regulation 338 ( 60) 770 ( 60) 17.75 7.79 10.83
[ UAveiro ] Regulation 338 ( 25) 165 ( 25) 7.40 15.15 9.94
[ UNIMAN ] Regulation 338 ( 16) 47 ( 16) 4.73 34.04 8.31
[CIPS-ASU ] Regulation 338 ( 35) 521 ( 35) 10.36 6.72 8.15
[ USzeged ] Regulation 338 ( 15) 65 ( 15) 4.44 23.08 7.44
[ UMich ] Regulation 338 ( 19) 259 ( 19) 5.62 7.34 6.37
[ PIKB ] Regulation 338 ( 9) 15 ( 9) 2.66 60.00 5.10
[CCP-BTMG ] Regulation 338 ( 9) 19 ( 9) 2.66 47.37 5.04
[ KoreaU ] Regulation 338 ( 2) 12 ( 2) 0.59 16.67 1.14
[ASU+HU+BU] Regulation 338 ( 1) 13 ( 1) 0.30 7.69 0.57
[ Team 09 ] Regulation 338 ( 0) 0 ( 0) 0.00 0.00 0.00
Task 2
------------------------------------------------------------------------------------------------
TEAM gold (match) answer (match) recall prec. fscore
------------------------------------------------------------------------------------------------
[UT+DBCLS ] Regulation 349 ( 92) 201 ( 92) 26.36 45.77 33.45
[UAntwerp ] Regulation 349 ( 36) 124 ( 36) 10.32 29.03 15.22
[ Team 24 ] Regulation 349 ( 26) 94 ( 26) 7.45 27.66 11.74
[CNBMadrid] Regulation 349 ( 65) 913 ( 65) 18.62 7.12 10.30
[CCP-BTMG ] Regulation 349 ( 9) 19 ( 9) 2.58 47.37 4.89
[ASU+HU+BU] Regulation 349 ( 1) 13 ( 1) 0.29 7.69 0.55
Task 3
------------------------------------------------------------------------------------------------
TEAM gold (match) answer (match) recall prec. fscore
------------------------------------------------------------------------------------------------